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ABSTRACT 

A study was initiated at University College of the 
University of Cincinnati to test the effect of composing and revising 
at a computer on the writing performance of developmental English 
students. Students enrolled in English for Effective Communication 
(EEC I) were divided into three groups: a control group that did net 
use the computer at all; a group who had access to Apple He 
computers equipped with Bank Street Writer II word processing 
software; and a computer group using Bank Street and Writer's Helper, 
software which guides the students through the entire writing 
process. At the end of Winter 1989, after 7 of the 11 quarters of the 
study had been completed, 698 students had enrolled in E-C I. Study 
findings, based on students' essays, freshman English entrance 
examination scores, and course evaluations, included the following: 
(1) the control and Writer's Helper groups had the highest average 
scores on the first of the four major papers in EEC I, while the Bank 
Street Writer group had the highest percentage passing the entrance 
exam; (2) only 27.4% of the students had no prior computer 
experience; (3) while students felt that using the computer in 
composition courses was enjoyable, helpful, and increased their 
self-confidence, they were significantly less willing to grant that 
computer use contributed to their skill in writing; (4) the two 
computer groups rated both their instructors and courses more highly 
than did the control group; and (5) students were reluctant to use 
the computer for intellectual experimentation, valuing it more for 
its convenience. Tentative conclusions suggest that computer use may 
affect students' attitudes more than their writing performance. 
(ALB) 
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THE EFFECT OF CLASSROOM COMPUTER USE ON COLLEGE BASIC 
WRITERS: A CONTROLLED STUDY IN PROGRESS 

--Deborah T. Meem 

University of Cincinnati 

In the past decade the composition classroom has taken 
on an entirely new look. Just yesterday, it seems, we 
rhetoricians confessed--smugly , perhaps--to a certain 
squeamishness in the presence of Technology. Now many of us 
use computers not only for our own work, but also in our 
classrooms. But does the word processor really help 
students to write better? Many scholars have attempted to 
answer that question. However, as is obvious from the chart 
in Fig.l, these studies have been far from conclusive. 
Hawisher (1988) states that "results from research [since 
1981] were varied and conflicting." Many excellent studies 
have been undertaken; but in general, they involve small 
samples, they focus on one quarter or semester only, and 
they do not include a control group. The small sample 
factor is particularly disturbing. Travers (1964) calls 
deficiencies due to insufficient cases "one of the most 
elementary errors in experimental design." 

We hope to offer a different approach. At University 
College of the University of Cincinnati we are in the midst 
of a study designed to test the effect of composing and 
revising at the computer on the writing performance of 
developmental English students. Our project team — Deb Meem, 
Floyd Ogburn, Janet Reed, Gary Vaughn, Rex Easley, and Mary 
Benedetti of the University College Language Arts 



department— seeks to examine a large sample of students 
enrolled in English for Effective Communication (EEC) I. 
EEC is a developmental English course required of all 
students who score 3 or less (6-point scale) on the 
holistically graded Entrance Exam in English composition 
administered to all freshmen during orientation. In this 
course we stress both grammar and paragraph organization as 
we prepare students for the Entrance Exam retake at the end 
of the quarter. Although we are not rigidly dogmatic, in 
EEC we teach process writing roughly in line with the 
philosophies of Peter Elbow, Don Murray, Janet Emig, and 
other theorists. EEC students oart icipating in the study 
are divided into three groups: (1) a control group who do 
not use computers at all; (2) a group who have access to 
Apple lie computers equipped with the Bank Street Writer II 
word processing program; and (3) a computer group using Bank 
Street plus Writer's Helper, a "thinking aid" supplementary 
program which quides students through the entire writing 
process --prewr iting , organizing, composing, and revising . 

Background . 

The EEC program in University College/UC is 
particularly well suited to a project of this type. EEC 
represents an established developmental English program in 
an open-admission two-year college located on the main 
campus of a large urban university. Our location and our 
mission together guarantee a fairly constant student 
population, including many from local inner-city high 



schools. The university College is committed to excellence 
in teaching, and its administration looks favorably upon 
research in this area. In addition, the University College 
administration has consistently allotted generous financial 
backing to its developmental programs. In our case, EEC 
benefits from this ample support: most courses are taught by 
full-time faculty; classroom work is supplemented by a 
Drop-In Writing Lab staffed by professional tutors; basic 
writing courses have a mandated maximum class size of 17 
students; two professional tutors are present in class twice 
a week to assist the instructor and allow for frequent 
individual consultation; and finally, the EEC faculty has 
had the opportunity to design and equip an Apple computer 
classroom. 

This computer teaching laboratory is truly a customized 
phenomenon. We have outfitted a classroom with 17 Apple He 
computers (-to match the maximum EEC class size) positioned 
in four rows, each row also containing one Imagewriter 
printer accessible to individual computers via an electronic 
switchbox. The printers are located in the middle of each 
row; there is thus a "group" of two or three computers on 
each side of the printer. This built-in grouping 
facilitates interaction among students, and allows novice 
computer users easy access to more experienced neighbors. 
The 17 computers are linked to a Corvus hard drive and data 
bank. All computer classes use the Bank Street Writer word 
processing program, network version; we are thus able to 



dispense with the cumbersome process of distributing and 
keeping track of floppy disks for each student. We assign 
individual volume numbers and passwords to each student, to 
allow some privacy. The EEC course requires two "lab" days 
per week, so students automatically get a minimum of two 
hours at the computer. Many students arrange to come in 
when classes are not meeting so as to have more time with 
the computer; or they may use -the four additional Apples 
located in the Writing Lab. 

Software . 

Bank Street Writer is an extremely us°r-f r iendly word 
processing program, designed for the neophyte. The writer 
generates text within a rectangle which occupies the bottom 
5/6 or so of the screen. Above the text box are easy-to- 
follow directions for operating the program. There are no 
bells and whistles with Bank Street Writer--one PRINT-DRAFT 
and one PRINT-FINAL option only, for instance—but the 
program is easy to use, and our basic writers produce 
material on-screen within fifteen minutes of their first 
encounter with it. 

Writer's Helper is a "thinking aid" program which 
includes eleven "Find and Organize a Subject" exercises, and 
eleven "Evaluate a Writing Project" exercises. In our EEC I 
course we use only certain parts of the "Find and Organize" 
menu. From "Find a Subject," our controlled study group 
uses Brainstorms (a free writing activity), Lists (possible 
subjects), and The Questioner (questions to help select a 
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subject). From "Explore a Subject" we use Crazy Contrasts 
(comparison of the student's writing topic to another, 
unusual subject, e.g. "List three ways your subject, MY 
BOYFRIEND MIKE, is li*e an iceberg"), Teacher's Questions 
(questions supplied by us and geared to a specific writing 
assignment), and Three Ways of Seeing (examination of the 
student's topic in isolation, as a process of change, and in 
relation to other subjects). When time permits, some of us 
go on to two "Organize Information" activities, Trees 
(grouping thoughts about a subject into categories), and 
Develop a Single Paragraph (a guide for writing descriptive 
or argumentative paragraphs). The "Evaluate a Writing 
Project" section of Writer's Helper involves basically 
CAI-type components: word counts, readability level, usage 
checks. Our teaching group found that this type of 
evaluation information required a great deal of explanation 
and interpretation for our EEC students, so we limit student 
usage of this part of the program. 

Methodology. 

Our goal has been to devise an experimental study to 
test whether developmental-level students benefit in any 
concrete ways from access to computers for composing, 
revising, and editing. With six of us teaching special 
"controlled study" sections of EEC I, we have an available 
sample (students who complete the course and receive a final 
grade) of approximately 200 participants per year. This is 
a much larger sample than any previous study has been able 



to test, and represents a huge advantage for us as we seek 
to establish statistical credibility. At the same time, the 
multiple intructors/large sample factor presents certain 
problems. Our teaching styles and grading standards differ. 
How could we overcome these natural differences and assure 
that all EEC I students involved in the study have in fact 
studied the same material and had comparable educational 
experiences? 

In setting up the controlled study we made a strong 
effort to control variables. Our original five-person 
teaching team (now expanded to six) agreed that a 
standardized EEC I course was a necessity, we therefore 
hammered out not only a common syllabus, but a common 
day-by-day schedule we could all follow. Although we made 
no effort to influence individual classroom styles, we felt 
confident that we would all teach a common course content. 
Grading posed another problem. Obviously, we could not 
group-grade every paper. Yet we war:ted to set common 
standards. Our solution to this problem was to select an 
"anchor" student from each section to serve as a subject for 
norming. This was to be the "average" student, who scored 3 
on the Entrance Exam and whose placement test score in 
reading (University College uses the Degrees of Reading 
Power test) was as close as possible to the average DRP 
score for all EEC-placed students that quarter. After each 
paper came due, the teaching team met and group-graded the 
anchor papers. This norming session allowed us to discuss 
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expectations and standards for each writing project, we 
established a point system for grading as an additional 
attempt at consistency; furthermore, points allow for easy 
data entry and averaging at quarter's end. 

In the context of this standardized course, we decided 
to divide our EEC I sections into three groups of 
approximately equal size: a non-computer control group, a 
word processing group, and a "thinking aid" group. Our 
rationale for identifying three groups instead of only two 
was that with our large potential sample we felt we could go 
beyond simply focusing on word processing as a composition 
tool. We could test for differences in degree of computer 
intervention, and see if Writer's Helper's structured 
prewriting and organizing activities led to added skill in 
composition and presentation, EEC sections are assigned 
randomly to groups, based on instructor schedules and 
availability of the computer room; students do not know 
until the first day of class whether they will use the 
computer or not. In a further attempt to control variables 
in the study, each instructor was assigned both computer and 
non-computer classes, and/or Bank Street and Writer's Helper 
classes. In other words, we tried to arrange the teaching 
assignments so that no one instructor taught all one 
classi f icat ion , 

Results , 

And now we take up tnat elusive quest ion--did the 
computer users perform better than the control group? So 
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far the results are equivocal at best. Through the end cf 
Winter quarter 1989, 698 students have participated in our 
study. Of these, 233 have been assigned to non-computer 
control sections, 233 to computer classes using Bank Street 
Writer only, and 232 to sections utilizing the Writer's 
Helper as a computerized teaching supplement. If we compare 
the results of the three groups [Selected Results by Group, 
Fig. 2], no one division stands out as statistically superior 
to the others. After seven quarters the Control and 
Writer's Helper groups show the highest average scores on 
the Interview essay (the first of the four major papers in 
EEC I); the Bank Street Writer group has the highest 
percentage passing the Entrance Exam. Overall, however, 
what is most interesting about Fig. 2 is not how the three 
groups differ, but how remarkably close they are. It is 
also interesting to notice, as we look at Fig. 2, that if we 
had ended our study after a sir ie quarter (F86), we would 
have had to conclude that using computers might actually 
hurt performance. This trend has evened out considerably 
since then, probably because the instructors have become 
much more proficient in exploiting the possibilities of the 
computer. Nevertheless, at this point we must say that 
access to a word processor does not lead to quantifiable 
improvement in our students ' performance . This result jibes 
with recent research—War ant z & Keech (1982), for 
example—which indicates that longitudinal studies in 
writing require a minimum of sixteen months (as opposed to 
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our ten weeks) to show observable progress. Thus it is not 
surprising that we did not observe any tangible improvement 
in our EEC computer students. 

A different trend is visible, however, in the results 
of the evaluation forms completed by each student during the 
last week of the quarter. These forms have three parts. 
All controlled study participants, computer and control, do 
Part 1, which centers around 14 questions based on the 
widely used Purdue Cafeteria evaluation instrument. These 
questions ask the student to rate the professor (for 
example, "My instructor has an effective style of 
presentation") and the course ("Assignments are interesting 
and stimulating"). All students in the Bank Street and 
Writer's Helper groups go on to Part 2, which focuses on the 
computer experience. Here participants rate their Apple 
work in terms of both enjoyment and effectiveness as a means 
of learning. They also indicate what, if any, prior 
computer experience they have had. Part 3 is reserved for 
the Writer's Helper group, and in this section students rate 
their level of satisfaction with the five components of the 
Writer's Helper program used in the course. Fig. 3 presents 
the evaluation summaries for computer classes, and reveals 
some interesting facts. When we first began experimenting 
with Apple lab teaching, we wondered how computer literate 
or illiterate our students would be. To our surprise and 
pleasure, it has turned out that only 27.4% of our EEC 
students enter the class with no computer experience at all 
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(and this percentage has dropped every quarter since the 
study began in Fall 1986, when the figure was 30.2%); more 
than half have taken an introduction to Computers course in 
high school. The Evaluation Results [also on Fig. 3] are 
also revealing, in section I ( BSW + WH) we see that while 
students value their Apple lab experience highly in the 
ateas of Enjoyment (5.1 out of 6), Confidence-building 
(4.82) and Helpfulness (5.03), they are significantly less 
willing to grant that computer use contributes to increased 
skill in writing (4.14). It appears that they value word 
processing for its convenience rather than for its ability 
to promote learning. Section II focuses on various Writer's 
Helper activities, and it is obvious that students prefer 
Teacher's Questions (4.32), Brainstorms (4.5), and Lists 
(4.6) to the more abstract Crazy Contrasts (3.78) and Three 
Ways of Seeing (3.9). This indicated preference reveals 
another aspect of the EEC student profile; we recognize 
individuals who are far more comfortable with direct, 
immediately applicable activities, such as list-making, than 
with mind-stretching creative work, such as Crazy Contrasts. 

So far I have painted a rather bieak picture of an 
ambitious experiment producing no visible results in terms 
of performance, nor any strong positive impressions in terms 
of explicitly stated student satisfaction. Yet in one 
significant way our EEC computer students do react 
positively to their Apple work. Examination of the Purdue 
data from Part 1 of the evaluation shows that students in 
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the two computer groups rate both instructor and course 
higher across the board than do their control group 
counterparts. Fig. 4 focuses only on the three final and 
most global Purdue statements. [I should remind the reader 
at this point that if scores in the 3 range out of 5 seem 
low, EEC is a required course for students who have failed a 
writing exam. Many students resent their placement in EEC, 
and course evaluations reflect this resentment.] While the 
control group averaged 3.41 agreement with the statement 
"Assignments are interesting and stimulating," the two 
computer groups averaged 3.7. in ccher woros, the computer 
students ^d the same assignments nearly .3 higher. Small 
differences are also visible for Purdue 13 ("This is one of 
the best courses I have ever taken") and Purdue 14 ("My 
instructor is one of the best teachers I have nad"). Same 
assignments, s*me courne, same inst ructors—yet the computer 
group consistently displays a more positive perception of 
EEC I than the control group. I say "consistently" because 
although Fig. 4 summarizes results for only three Purdue 
units, in fact the computer groups showed higher results on 
every one of the 14 Purdue questions. 

So what can we conclude from this data? The study is 
still perhaps four quarters away from completion, but at 
this point one would have to theorize t*;at developmental 
writing students perform at about the same levels 
objectively whether or not they have access to a computer as 
a classroom tool, and whether or not additional software is 
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available. Furthermore, they indicate a reluctance to 
utilize the computer as a vehicle for irtellectual 
experimentation rather than merely as a convenience product. 
On the other hand, however, evaluation results indicate a 
positive perception of the computer; this attitude is 
reflected not so much in explicitly computer-directed 
responses, but in intangible self-image areas and in overall 
good reaction to the course. EEC students like to use 
computers, and they like the way they feel about themselves 
when they use computers. 

Future Directions. 
Our teaching team plans on continuing the controlled 
study in the EEC I course at least through Fall 1990, with a 
target total sample of 1000 students. It seems clear at 
this point that we are not going to observe any thrilling 
quantum leaps in performance level in our computer users. 
But the non-quantifiable affective result is equally 
important to us, since attitude is crucial to success for 
writers in general and basic writers especially. We are 
also exploring some "spinoff" areas, and increasing our 
sample size should allow us to lend numerical credence to 
these results as well. We have seen some trends conuarning 
gender (of student, of professor) which warrant further 
investigation. We have extended the study through EEC II, 
the continuation course for the 38% or so of EEC I students 
who do not pass the Freshman English Entrance Exam. 
Finally, we have taken a first look at adult EEC students 



enrolled in University College's Pre-Technical Training 
Program, who appear to pass the Entrance Exam in startlingly 
high numbers when placed in Writer's Helper sections of EEC 
I. 

In short, we have much to do. We feel that the 
ultimate validity of our study, and others like it, depends 
to a large degree upon our ability to rely on a large sample 
population each year, and our willingness to gather data 
over time. Perhaps eventually we will see a relationship 
between computer use and enhanced performance; or perhaps we 
will discern no quantifiable positive result. In the latter 
case we will have to continue to be content with the 
subjective responses our students give. We may need to 
accept the fact that our Apples will ultimately affect 
attitude far more than achievement. At the basic writing 
level, this may be good enough. 



Fig. 1 . SURVEY OF RESEARCH IN WORD PROCESSING 



[adapted from Grl Hawisher, "Studies in Word Processing , " Computers & 
Composition , 11/86, snd "Research Update: Writing and Word 
Processing," C&C, 4/88] 
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Fig. 2. SELECTED RESULTS BY GROUP 
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Fig. 3. 

A. PRIOR COMPUTER EXPERIENCE 
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Fig- 4- PURDUE EVALUATION COMPARISONS (5-point scale) 
F86, W87, F87, W88, S88, F88, W89 

Assignments are interesting and stimulating- [Purdue 12] 

Control group average 3,41 

BSW group average 3,69 

WH group average 3,7 

BSW + WH (all computer) 3,7 

This is one of the best courses I have ever taken, [Purdue 13] 

Control group average 3,2 

BSW group average 3,36 

WH group average 3,52 

All computer 3,48 
My instructor is one of the best teachers I have had, [Purdue 14] 

Control group average 3,76 

BSW group average 3,84 

WH group average 4,02 

All computer 3,96 
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